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METHOD AND SYSTEM FOR COVERING MULTIPLE RESOURCES WITH A 

SINGLE CREDIT IN A COMPUTER SYSTEM 



TECHNICAL FIELD OF THE INVENTION 

The present invention relates in general to flow 
control of messages in a computer system, and more 
particularly to using a single credit to control 
transmission of messages in a system with multiple 
resources . 
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BACKGROUND OF THE INVENTION 

In a conventional computer system, messages are sent 
to and from various memories and interfaces. For example, 
the processor interface transmits messages to the 
memory/ directory interface. However, the message receiver 
does not always have available space to receive the 
sender's message. One system for ensuring that the 
receiver has sufficient space for receiving the message 
is for the sender to request a grant from the receiver 
prior to sending the message. If space is available for 
the message, the sender is granted permission to send the 
messa ge. Such a system has an inherent delay while the 
availability of the grant is determined. 

An alternative system utilizes the concept of a 
credit mechanism. In a credit mechanism system, grants 
are made ahead of requests and are stored up so that 
there is no delay in determining whether a grant is 
available. In a credit system, the message sender and 
message receiver each have a counter. The sender counter 
tracks how many resources the sender knows are available. 
The receiver counter tracks how many resources are 
available that it has not yet told the sender about. The 
messa ges are received in a first-in- first -out (FIFO) 
buffer of the receiver where the messages await 
arbitration and a slot in memory. For example, the FIFO 
buffer may be sixteen slots deep and the arbitration 
queue may have 64 slots. 

When the sender receives a signal such as a pulse 
from the receiver that the receiver has space in the FIFO 
buffer for a message, the sender counter is incremented. 
The pulse from the receiver represents one credit. When 
the sender counter is greater than zero, the sender can 
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send a message. Upon the sender sending a message, the 
sender counter is decremented by one credit . 

When the receiver counter is greater than zero, the 
receiver sends a pulse to the sender (which as described 
above causes the sender counter to be incremented) and 
decrements the receiver counter. In other words, the 
receiver transferred a credit to the sender. When a 
message is removed from the FIFO buffer into the 
arbitration queue, the receiver counter is incremented, 
representing an additional credit that is available but 
that has not yet been transmitted to the sender. 

Computer systems , however , often need to send 
multiple message types with different resource 
utilization patterns and thus would require a different 
type of credit for each message type and either a complex 
channel or multiple channels for transmitting credits and 
messages, adversely affecting both latency and bandwidth. 
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SUMMARY OF THE INVENTION 

From the foregoing, it may be appreciated that a 
need has arisen for a technique to handle multiple 
resources with a single type of credit. In accordance 
with the present invention, a method and system for 
covering multiple resources with a single credit are 
provided that substantially eliminate or reduce 
disadvantages and problems associated with conventional 
computer systems . 

According to an embodiment of the present invention 
there is provided a method and system for communicating 
to a sender an availability of receiving a new message. 
The system includes providing a plurality of buffers each 
having at least one corresponding slot for storing a 
message and providing a credit signal that communicates 
to the sender only when it is determined that all of the 
buffers have at least one of the corresponding slots 
available for storing a new message. Each of the buffers 
is monitored to determine whether at least one of the 
corresponding slots is available for storing the new 
message. A corresponding counter is provided for each of 
the buffers. Each counter is decremented when all of the 
buffers have at least one corresponding slot available 
for storing the new message. 

In another aspect of the present invention, each of 
the buffers is configured to receive a corresponding 
particular message type. The new message is received 
from the sender, the particular message type of the new 
message is determined, and the new message is loaded into 
the corresponding slot of one of the buffers which is 
configured for receiving the particular message type of 
the new message. 
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In a further aspect of the present invention, the 
counter of each of the buffers in which the new message 
was not loaded is incremented. After the loaded new 
message is freed from the buffer in which it was loaded, 
the counter of the buffer in which the new message was 
loaded is incremented. 

In another aspect of the invention, each of the 
buffers includes corresponding slots that are 
initialized. Prior to loading a first message into the 
initialized corresponding slots of the buffers, each of 
the counters are set to equal the number of the 
initialized corresponding slots in its corresponding 
buffer . 

In a further aspect of the present invention, six 

buffers are included. 

In yet another aspect of the present invention, each 
of the buffers is configured with a different particular 
message type . 

Other technical advantages may be readily apparent 
to those skilled in the art from the following figures, 
description, and claims. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the present 
invention and the advantages thereof, reference is now 
made to the following description taken in conjunction 
with the accompanying drawings, wherein like reference 
numerals represent like parts, in which: 

FIG. 1 is a block diagram illustrating an embodiment 
of the present invention. 

FIG. 2 is a flow chart illustrating an embodiment of 
the present invention. 
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DETAILED DESCRIPTION OF THE INVENTION 

FIG, 1 shows an embodiment of the present invention 
that includes in a computer system 20, a message sender 
22 and a message receiver 24. The message receiver 24 
includes six buffers 2 6 — a write buffer 2 8 , a read 
buffer 30 and four victim buffers 32. In other 

embodiments, the number of buffers can be greater or less 
than six. Each buffer 2 6 has at least one corresponding 
slot 34 for storing a message. In this embodiment the 
write buffer has slots for 32 cache lines, the read 
buffer has slots for 32 cache lines and each of the 
victim buffers has slots for 48 cache lines. Only two 
slots 34 are depicted in the buffers 26 shown in FIG. 1 
for the sake of simplicity. The message receiver 24 is 
capable of providing a credit signal over a line 3 6 that 
communicates to the message sender 22 only when all of 
the buffers 2 6 have at least one of the corresponding 
slots 34 available for storing a new message 38* 

A corresponding receiver counter 4 0 is provided for 
each of the buffers 26. The receiver counters 40 are 
initialized. Initially each receiver counter 40 is set 
to a number equal to the number of the slots 34 for 
messages that are available for the type of message 
corresponding to that buffer 26. In other words, the 
receiver counter 4 0 corresponding to the write buffer 28 
is initially set to thirty-two because that is the number 
of slots 34 in the write buffer. Each of the buffers 2 6 
is monitored by a monitor 42 to determine whether at 
least one of the corresponding slots 34 is available for 
storing the new message 38. However, the monitoring can 
be direct or indirect, i.e., rather than determining the 
status of the buffer 26 directly, the system may instead 
keep track of the new messages 38 loaded into and freed 
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from the buffer 26. Further, one monitor 42 may monitor 
more than one buffer 26. 

Each receiver counter 4 0 is decremented when all of 
the buffers 26 have at least one corresponding slot 34 
available for storing the new message 38. When a new 
message 3 8 is received, its message type is determined by 
a message type discriminator and router 44 (although 
separate devices or software programs may be used for 
each of these two functions) and the new message 38 is 
directed to the buffer or buffers 26 corresponding to the 
particular message type of the new message. Once the new 
message 3 8 is directed to the appropriate buffer or 
buffers 26, the receiver counter for each of the buffers 
2 6 that did not receive the new message 3 8 is immediately 
incremented. When the new message 38 is freed (i.e., it 
arrives but is not needed, later it is not needed or the 
system is finished needing the message) , the receiver 
counter 4 0 corresponding to that buffer 26 is 
incremented. If a situation arises wherein all the 
buffers 26 receive the new message 38, then none of the 
receiver counters 40 are incremented at that juncture. 
When all the buffers 26 are finished with the new message 
38, all the receiver counters 40 are incremented. When 
the receiver counters 40 for all six of the buffers 26 
are greater than zero, a credit signal via the line 36 
from a signal generator 46 is sent to the message sender 
22 and all six receiver counters 40 for buffers 26 are 
decremented one credit. 

The message sender 22 includes a sender counter 48. 
When the message sender 22 receives the credit signal on 
line 36, The sender counter 48 is incremented by one 
credit. When the message sender 22 sends a new message 
38, the sender counter 48 is decremented one credit. The 
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message sender 22 only sends new messages 3 8 when the 
sender counter 48 is greater than zero. 

FIG. 2 is a flow chart of an embodiment of the 
process for covering multiple resources with a single 
credit in accordance with the present invention. In 
block 100, the message sender 22 is initialized. In 
block 102, the sender counter 48 is set to zero and in 
block 104, it is determined whether one of the credit 
signals over line 3 6 has been received by the message 
sender 22. If the credit signal over line 36 has been 
received, then the sender counter 4 8 is incremented in 
block 106 by one credit. Whether or not the credit 
signal on line 36 has been received, in block 108, it is 
determined whether a new message 38 is ready to be sent. 
If a new message 3 8 is not ready to be sent, then the 
process returns to block 104 to determine if a new credit 
signal 3 6 has been received. If a new message 3 8 is 
ready to be sent, in block 110, it is determined whether 
the sender counter 4 8 is greater than zero. If it is 
not, the process returns to block 104. If the sender 
counter 48 is greater than zero, then in block 112 the 
new message 3 8 is transmitted to the message receiver 24 
and in block 114 the sender counter 4 8 is decremented by 
one credit and the process returns to block 104. 

As a person of ordinary skill in the art would 
recognize, in other embodiments, many of these steps can 
be practiced in parallel or in a different order. For 
example, decision blocks 104, 108 and 110 can be 
conducted in parallel or in a different order. 
Similarly, blocks 112 and 114 can be conducted in 
parallel or in a different order. 

With respect to the message receiver 24, in an 
embodiment, the message receiver is initialized in block 
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120. In block 122, each receiver counter 40 is set to 
the number of slots 34 in its corresponding buffer 26. 
In block 124, it is determined whether each receiver 
counter 40 is greater than zero. If each receiver 
5 counter 40 is greater than zero, in block 126 a credit 

signal over line 36 is sent to the message sender 22 and 
in block 12 8 each receiver counter 4 0 is decremented by 
one. Whether or not each receiver counter 40 is greater 
than zero, in block 13 0, it is determined whether any new 
10 messages 38 have been received. If a new message 38 has 

^ been received, in block 132 the type of message received 

is determined, in block 134 the new message 38 is 

M transferred to the buffer (s) 26 corresponding to the type 

of new message and in block 136 the receiver counter 40 
15 for each buffer 2 6 that did not receive the new message 

■4= 

: E 38 is incremented by one. Whether or not any new 

:1 messages 38 have been received, in block 138 it is 

U determined whether any slots 34 have been freed. If a 

□ slot 34 has been freed, in block 14 0 each receiver 

2 0 counter 4 0 that corresponds to a buffer 2 6 containing a 

slot 34 that has been freed is incremented by one. 
Irrespective of whether a slot 34 has been freed, the 
process returns to block 124 to determine whether each 
receiver counter 40 is greater than zero. 
25 A person of ordinary skill in the art would 

recognize that many of the above-described steps in 
another embodiment could be implemented in parallel or in 
a different order. For example, decision blocks 124, 130 
and 138 could take place in parallel or in a different 

3 0 order. Similarly, blocks 126 and 128 could occur in 

parallel or in a different order. 

By using the process of the present invention, a 
more efficient usage of resources is obtained. The 
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resources are used in a cooperative way to send one 
credit when all of the buffers 26 have a resource free 
but yet returns a credit more quickly than would be the 
case with a more simplistic approach. The process allows 
for more complex internal functions while still 
communicating by means of a simple channel with only one 
credit. The FIFO buffer can be eliminated. Further, the 
system and method can be used with a conventional message 
sender because the message sender does not see the logic 
or the multiple resources associated with system. 
Rather, the message sender 22 only sees the message 
receiver 24 and only receives the same credit signal over 
line 36 it received from conventional systems. That the 
message receiver 24 only sends a credit signal over line 
36 when all buffers 26 have at least one resource free is 
invisible to the message sender 22. The present 

invention increases memory utilization, provides higher 
bandwidth and lowers latency. 

Thus, it is apparent that there has been provided, 
in accordance with the present invention, a method and 
system for covering multiple resources with a single 
credit in a computer system that satisfies the advantages 
set forth above. Although the present invention has been 
described in detail, it should be understood that various 
changes, substitutions, and alterations may be readily 
ascertainable by those skilled in the art and may be made 
herein without departing from the spirit and scope of the 
present invention as defined by the following claims. 



